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In this paper we explore the effect of non-unitary neutrino mixing on neutrino oscillation prob- 
abilities both in vacuum and matter. In particular, we consider the Vt channel and using a 
Neutrino Factory as the source for //^'s discuss the constraints that can be obtained on the moduli 
. and phases of the parameters characterizing the violation of unitarity. We point out how the new 
■ CP violation phases present in the case where the non-unitary mixings give rise to spurious "de- 
' generate" solutions in the parameter space and discuss how the true solutions can be extricated by 
, combining measurements at several baselines. 
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I. INTRODUCTION 



^p^. There is a phenomenal increase in our knowledge of neutrino properties in the past few years coming from neutrino 
^ i' oscillation data from solar, atmospheric, accelerator and reactor neutrino experiments. For three neutrino flavours, 
1^ , there are nine parameters characterizing the light neutrino mass matrix, the three masses, three mixing angles and 
three CP phases. Neutrino oscillation data determines the best-fit values and the 3(t ranges of the mass squared 
differences and mixing angles as [H 



^ ' • Combined analysis of solar and KamLAND reactor neutrino data gives the best-fit values and 3(t ranges of mass 

■"nI" , and mixing parameters as Am^i = — ml = 7.9!tog • 10~^ eV^ and sin^ ^12 = O.Sllg Qg. The solar data 

implies Atojx > . 



• Global analysis of atmospheric neutrino data from SuperKamiokande and data from accelerator experiments 
r4 ■ K2K and MINOS gives | Amj^ |= |m| - m?| = 2.5t_oi ' 10"^ cV^ and sin^ 623 = O.btow- 

O . 

00 . • The value of the third leptonic mixing angle 6*13 is not yet known and at present it is bounded to be sin'^ 6*13 < 0.05 

' leaving open the possibility of very small or zero value for this. 



This tremendous progress has initiated the precision era of neutrino physics, and experiments are planned and proposed 
to further increase the precision of the known neutrino parameters and to pin-down the value of the mixing angle ^13 
and determine the sign of Amgj^ (sign[Am3]^]) ^. 

A non-zero value of 613 is intimately related to the possibility of observation of CP phase in the lepton sector. A 
large value of 6113 would also enable one to determine the signlAml^] through observation of large matter effects for 
neutrinos propagating through earth [1, H, [i [■ If ^13 is relatively large, sin^ 2^13 ^ 0.01, then the answers to these 
questions may be obtained from superbeam a01 and future atmospheric neutrino experiments [1, 0, H, H, [13, [ill, [Hi ■ 
However, if Nature selects ^13 to be smaller than this, then one has to go to either /9-beam or neutrino factory 
experiments. The R&D for both are actively pursued [l3,[i3l- Future facilities also have the potential to discover 
new physics [H, M, [13, [H, [H, HO] . 

The best-fit values of masses and mixing angles quoted above are obtained assuming the neutrino mixing matrix 
(Pontecorvo-Maki-Nakagawa-Sakata (PMNS) matrix) to be unitary. However, for models with heavy fermionic fields. 
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the deviation of the leptonic mixing matrix from unitarity is a generic feature |2ll . |23 . l23j . A typical example is the 
type-I seesaw mechanism (2^. [25l [26l. [27l. [28| which provides a natural framework of generating small neutrino masses. 
This requires introduction of one or more heavy right handed singlet neutrino field(s) . Although the full mixing matrix 
at the high scale is expected to be unitary in these cases, the mixing matrix relevant for low energy phenomenology is 
not unitary as the production of the heavy particles are kinematically forbidden. However the violation from unitarity 
in the canonical Type-I seesaw mechanism is found to be very small if the mass scale of the heavy neutrinos are of 
the order of the GUT scale ~ 10^® GeV and the heavy neutrinos decouple and do not influence the physics at low 
scale. However non- minimal seesaw models have been constructed with heavy neutrinos of mass 0(1) TeV, invoking 
symmetry arguments to suppress the seesaw term .29, 30, 31, 32|]. Such models can give rise to significant light-heavy 
mixing and deviation from unitarity. The TeV scale seesaw models are interesting as these can have signatures in the 
Large Hadron Colliders (LHC) in the near future ^3§, 's^, . Also successful leptogenesis can be generated if the 
heavy Majorana neutrinos are quasi-degenerate [36, 37, 38]. There are also models with heavy neutral (gauge singlets) 
which can give large light-heavy mixings (39l. kol. klj . In the i?-parity violating supersymmetric models, neutrinos can 
also mix with neutralinos [4^ . Since deviation from unitarity is due to the physics at the high scale, a measurement 
of them at the low scale can serve a window to the physics at high energy. Hence it is important to probe if the future 
precision neutrino experiments can give any indication towards the non-unitary nature of neutrino mixing matrix. In 
this paper we address this question. 

The non- unitary nature of the neutrino mixing matrix due to mixing with fields heavier than Mz/'2 can manifest 
itself in tree level process like tt — > yiti/, Z — > Dv, W —f ot in flavour violating rare charged lepton decays like fi — s- 67, 
r — » iiy etc., which proceed via one-loop processes and hence can be constrained from low energy electroweak data 
[2ll . [2^ . |40| . [4U_ 4Jj_ 4^ 4^^ 43j_ 3 . Non-unitarity of neutrino mixing matrices can also affect the neutrino oscillation 
probabilities |49l. ISOl. ISll. l52l. l53l. l54l| . In this paper, we concentrate on the effect of non-unitarity on neutrino oscillation 
probabilities and the possibility of probing this in neutrino factories. We show that the effect of non-unitarity can 
be more pronounced in the appearance channel than in the survival channel. In particular, we look into the effect 
of deviation from non-unitarity in the Vp,-VT channel since the present constraint on the non-unitarity parameter in 
this channel is much weaker than the constraint on the v^-v^ channel. We consider Vr detectors like OPERA [HHl 
or ICARUS [H] detectors for CERN Neutrinos to Gran Sasso (CNGS) oscillation search programme and 

discuss the possibility of constraining the moduli and phases parametrising the unitarity violation. These phases 
characterizing the non-unitarity constitute a new source for CP violation which can be present even in the limit of 
013 — > 0. We also discuss the matter effects in the presence of non-unitarity and show that for a non-unitary mixing 
matrix, matter effect can manifest itself even in the limit of the third leptonic mixing angle ^13 — > and in the One 
Mass Scale Dominance (OMSD) limit of Amji/Amgj^ 0. There is some overlap of our work with Ref. [s^l who have 
also constrained non-unitarity violation using the v-y channel. However, we consider the possibility of combining 

several baselines, reducing the degeneracy of parameter space. To distinguish the non-unitarity signature with that 
of non-standard interactions, the combination of the baselines is useful. When two or more observations suggest the 
same parameter region for scenarios with non-unitary lepton mixing matrix, there can be stronger implications to 
determine the origin of the signal beyond the standard oscillation scenario. 

The plan of the paper is as follows. In the next section discuss the parametrization that we use for non-unitary 
mixing matrices and present the current constraints on unitarity violation. In section III we give simplified expressions 
for the oscillation probabilities in vacuum and matter assuming the mixing matrix to be non-unitary. In section IV 
we discuss the degeneracies in the oscillation probabilities. In section V we give our numerical results on the allowed 
regions of the parameter space in the model with the non-unitary PMNS matrix. We conclude in section VI. 



II. NON-UNITARY MIXING MATRICES AND CURRENT CONSTRAINTS 



Since non-unitarity of mixing matrices is a generic feature of theories with heavy neutrinos we consider a picture 
with three light and one heavy neutrino. In this case the full 4x4 mixing matrix is unitary but the 3x3 light neutrino 
submatrix is non-unitary. A 4 x 4 unitary matrix can be parametrized by 6 angles ^12, 13, 14, 23, 24, 34 and three phases 
'^13,24,34- If the neutrinos are Majorana in nature then three additional phases can be present. We parametrize the 
4x4 unitary matrix in the usual way in terms of the rotation matrices i?y 



U = R34R24R14R23R13R12P 



(1) 
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where the Rij represent rotations in ij generation space, for instance: 
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(2) 



with the usual notation Si 



sin 6ij and Cij 



cos 9ij. The symbol tilde means the mixing matrix including the CP 



phase. The diagonal matrix P contains the three Majorana phases, which we denote a, (3 and 7: 



P = diag ( i,e-W2^e-'('^/2-*-),e-'(^/2-534) 



(3) 



Since the Majorana phases are not important for oscillation studies henceforth we will omit the matrix P. 

Assuming the mixing of the fourth heavy state to be small, the above equation can be expanded in terms of small 
parameters ee, and e,- characterizing the 14, 24 and 34 rotations respectively^. With this simplification Eq. ([T]) can 
be expressed as 



U = 



( 



W 



Us2 Us?. 1 



(4) 



\{el + el + el) ) 



where W is the 3x3 non-unitary mixing matrix. This can be written as, 



W 



I U,,{l-el/2) Ue2{l-el/2) U,3{1 ~ el/2) \^ 
[/^i(l-62/2) U^2{l-el/2) t/^3(l-e^/2) 



Uri{l-el/2) Ur2{l-4/2) C/,3(l-e?/2) 



-e "•'-tetTUel 



(5) 



4> = 82 



!J34 



Us 



eT-Urk, and the 3x3 matrix Uai with a = e, /i, r and i = 1,2,3 



is defined and parameterized as the usual unitary PMNS matrix for three generations. 

Bound on the moduli of the unitarity violation parameters can come from electroweak processes and from neutrino 
oscillations. The bounds obtained from present neutrino oscillation experiments are weaker than those obtained 
from electroweak decays [22|. Constraint on Y^i=i^aiWp^ comes from rare decays of charged leptons la I pi 

MM 



I37|,l40|,l4l|. Whereas X;,=i I W'mP can be constrained from processes like W ^ Iv, Z ^ vv. Constraints 



on the diagonal elements of the non- unitary matrix can also come from tests for lepton universality [21|, [2^, |40|, |4]| . 
At present there is strict constraint on light-heavy mixing in the e-\i sector coming from non-observation of the decay 
/i 67. For non-unitarity induced through heavy right handed neutrinos the bound quoted in Ref. (sgI . [37l | is 



€ee^, ^ 1.2 • 10- 



(6) 



The bound on the /x-r sector is much weaker 

3 



1=1 



e.e, < 2 • 10- 



(7) 



The e^s are also constrained by electroweak measurements individually as [3J, |4S 



el < 0.012, el < 0.0096, < 0.016. 



(8) 



^ We use cos^ 



and sinOij — — sin&ji — e^, where ex is the corresponding index, e, fj, or t. 
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III. CALCULATION OF OSCILLATION PROBABILITIES 

A. Oscillation Probability in Vacuum 

The most general expression of survival/oscillation probability for j/q, in vacuum without assuming unitarity 

of mixing matrices is [50| 



1 



light 
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mf)L 



2E 



(9) 



where 7V„ = E'!='i \Wc^\^ ; R^p = MWp^W*^iW*p^W^,]■ = lm[Wp,W:.^W^^W^,], and the sum of the mass 
eigenstate index is taken with the states which concern with the neutrino propagation (which is mentioned as "light" 
here). Although we consider a 4 x 4 mixing matrix (for the three light mass eigenstates and one heavy one) in the 
previous section and in the rest of the paper, the above expression for probability can be applied to the more general 
case where W is the part of the larger unitary matrix than 4x4. 

If we concentrate on baselines and energies such that the OMSD approximation can be employed, then the terms 
containing Am2iL/{AE) can be neglected and the expression simplifies to 



1 
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2E 



(10) 



As mentioned above, there is already strong constraint on the combination of the parameters CeC^. Therefore we 
assume ee = throughout this article. With this assumption, the deviation of unitarity can occur in the i/^ — *■ i^^ , 



j/^ — > v-T and 
be expressed as 



channel. In the limit of 9 



P. 



13 — > and Am2i/Am|]^ 0, the survival probability P^^^^^ can 
. 2 Ato§iL 



1 - sin^ 26*23 sin 



AE 



(11) 



From this equation, we see that the second order of the non-unitary effects in each term cancel out with the nor- 
malization factor l/iV^. In the Vt — > Vr channel, the non-unitary effect comes as a small correction to the standard 
oscillation term and the standard oscillation term dominates. On the other hand, the oscillation probability for 



Vr is approximated as 
p 



-I- sin 26*23 {sin 26*23 + 
+ {e^Er sin (/) sin 2^23 



2t^tr cos 26*23 COS0 0(e^)} sin 
fC'(e^)}r" 3^ 



. 2 Am^iL 



AE 



sm ■ 



2E 



(12) 



The term with sin </> takes a different energy dependence from the standard oscillation term. Therefore, we can expect 
that this can be distinguished from the standard oscillation signals. The term of 0{e^) in the standard oscillation term 
(sin^ Am3]^L/(4i?) term) cannot be important because it is always smaller enough than the standard contribution 
sin^ 2023- Assuming L = 130 km. i? = 50 GeV, and e^e^ = 10~^, the order of each term is calculated to be 



, , .„ . . o AtooiL 
standard osculation term: sm — — ^ 

AE 

1.7- 10-^ 



sin (j) term: sin ■ 



Am3^L 



2E 



zero-distance term: e„e^ = 10 



6.8-10" 



(13) 

(14) 
(15) 



Alternatively one can study the violation of unitarity in both Ue_ — > v-r channel and — > Vt channel [54 
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and the three terms in Eq. (|12p are thus of the same order of magnitude and this channel provides a better option for 
probing violation of unitarity. 

The noteworthy feature of the above equation is the zero-distance term e^e^. Consequently for a near detector one 
gets, 

P::Z.^ = elel. (16) 

It is actually very small. However, there are two positive aspects: (i) a huge number of neutrinos comes into the near 
detector (ii) the background for this process, i.e., the standard oscillation events, is highly suppressed. 



B. Oscillation Probability in Matter 

When we introduce the non-unitary PMNS matrix, neutrinos obtain the additional matter effect mediated by 
neutral current [5l|, [H, [s^^. For non-unitary mixing, the i^^ Vr oscillation probability in matter of constant 
density in the simplifying approximation of and Amjj^/Amgj^ — > can be expressed as. 



: sin 26*23 (sin 26*23 + 2e^er cos 26*23 cos 0) sin^ — (- e^ei- sin (j) sin 26*23 sin '^^ 



^t^^-r I r.rn sm-' 26*23 cos (/) sm — TTF ^e^*^^ — 2~ sm 26*23 cos 26*23 cos 0sm — 77^ 



'31 

^ sin^ 2023 cos 2e,,iel - d) sin^ + sin^ ^23 cos 29,,{el - e?) sin 

+ 0(e3) + 0(si3)-f ©(Am^./Am^i), (17) 

where anc is the matter effect mediated by neutral current interaction. This is consistent with the result shown 
in Ref. [53| though the procedures used are somewhat different. Since ^23 — 7r/4, we can omit the terms which 
proportional to cos 26*23, and finally, it is reduced to 



Py^^y^ = sm 26*23 sm — ^ h e^e^ sm 26*23 sm (j) sm — ^ e^e^ ( I snr 26*23 cos sm — . 



(18) 



This formula can nicely explain the numerical result which will be shown in the following sections. We have an 
additional term in comparison with Eq. (jl2p , which depends on cos (j) differing from the vacuum term. This is the 
key feature to resolve the degeneracies which will be explained in the next section. The details of the derivation are 
described in Appendix. 



IV. DEGENERACIES 



From the expression Eq. (jl2p for the oscillation probability Pu^—^u^ in vacuum, we see that this is invariant under 
the following transformations: 

1. 6*23 (octant) degeneracy: Pu^^y^{92z) = P,y,,^^^ (7r/2 - 6*23), 

2. sign[Am§i]-0 degeneracy: P,,^^^^(Am§i > 0, 0) = Pi.^_^^(Am§i < 0,-0), 

3. 0-(7r - (f) degeneracy: P^^^^^icf)) = P^^^^^{ti ~ </>), 

4. (epeT-)-0 correlation (quasi-degeneracy): Py^^i,^ {{ei_i,er), (f)) = Pu^^i,^ ((e,,er)', <?!>')■ 

Here, the values of oscillation parameters which are not explicitly shown are taken to be the same on both the sides of 
the equations. These can give rise to degeneracies in the (e^eT-)-0 plane even in the limit ^13 — ^ 0. Below we discuss 
these degeneracies. If 6*13 is non-zero then the additional degeneracies due to 5cp can also be there. But this will 
not give rise to any additional degenerate solutions in the {e^tT)-4' plane. Note that in addition to the degeneracies 



The non-standard matter effect mediated by neutral current interactions was also discussed in Ref. [s^ . 
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e^Er and occur in a correlated fashion in the oscihation probabihty shown in Eq. (|12p . Hence the uncertainty in 
determination of one of these parameters can affect that of the other even for the same hierarchy. When we assume 
the maximal mixing for 623, the 623 octant degeneracy is not present. 

The expression Eq. (fT8|) breaks some of the degeneracies. Because of the presence of the cos (f) term, induced by 
matter effect, sign[Am|]^]-(/) and (j)-{'ir — </>) degeneracies can be resolved if we can see this term. To do so, we have to 
go to the long baseline because the term is simply proportional to the baseline length. However, in the long baseline 
region, the standard oscillation term can be order one, and the tiny non-unitarity effect could be easily absorbed by 
the standard oscillation term. The significance of the non-unitary matter effect should be checked numerically. The 
(e^eT-)-(/) correlation is present in the oscillation probability in matter as well. 

We can illustrate the occurrence of degeneracies due to the invariance listed above by using the equi-probability 
plots [H]. Here, the standard oscillation parameters are fixed as, 

sin^ 012 = 0.31, sin^ 2013 = 10"^ Sep = 0, 
|Am^i| = 2.5 • 10"'"' [eV^], Am^i = 7.9 • 10"^ [cV^], (19) 

and 023 and the sign of the atmospheric mass square difference will be given later. For the non-unitary parameters, 
we adopt 

(e^e^)t™ = 10-2, 0*™'= = 7r/4 (20) 

as the reference values throughout this papcr^. The equi-probability curves shown in the following mean that the 
condition 

P.^._,^ ((6^e.)«', 0fi') = F,^^.^ ((£pe.)*™°, , (21) 

is fulfilled on each curve. 




10"' 10"^ 10"' 10"' 10"^ 10"' 10"' 10"- 10"' 

(e^e.)'" (^,^rf 



FIG. 1: Equi-probability plots for 623 degeneracy (left), for sign of Amli degeneracy (centre), and for (/'-(tt — (f) degeneracy 
and correlation (right). The neutrino energy is taken to be 50 GeV and the source-detector distance is 130 km. 

The left panel in Fig. [1] is for the 023 degeneracy. The plot is done for i? = 50 GeV, and the baseline is taken to 
be 130 km with 2.7 g/cvc? as the matter density although matter effect is not relevant in this setup. In this plot we 
draw equi-probability contours in the {e^trYij) plane for two values of 023, 

sin2 023 = {0.64, 0.36}. (22) 

Here we assume the NH mass spectrum. The plot shows that the curve with sin^ 023 = 0.64 (thin solid) completely 
coincides with that of sin^ 023 ~ 0.36 (thick dashed gray), and these two cannot be distinguished. However, this 



^ More precisely, we take e'j"^"" = e'"^""^ = 0.1 in our numerical calculations. This allocation does not affect the results since the leading 
contribution of the non-unitarity always appears as the combination epe^. 
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degeneracy docs not give rise to any additional regions in the {e^er)-4' parameter plane because this degeneracy is 
not due to the non- unitary parameters, i.e., the degenerate solutions take the same values of (e^Cr) and in the both 
side of Eq. dill), 

P.,-... (^23, (e^er), 0) - P.,^.^ (V2 - 023, (e^er), 0). (23) 

The middle panel in Fig.[T]is for the degeneracy on sign[ATO|]^]-(/). The solid curve is similar to the curves in the left 
panel. Here, the standard oscillation parameters are again taken to be the values in Eq. (fT9|) but sin^ 823 is assumed 
to be 0.5, and the NH is adopted in the both side of Eq. (PT|) . In the calculation of the dashed (blue) curve, the 
true probability with NH is fitted by the probability with the IH mass spectrum. Therefore, the condition which is 
satisfied on the dashed curve is written as 

P,^^,^i{e^erf\^''\m) = P.,_.,((e^e.)*'--,(/<*™°,NH). (24) 

Although the dashed curve does not pass through the true value point which is shown as the black dot in the plot, 
the true oscillation probability can also be reproduced on it. The shape of the dashed curve is the reflection of the 
solid curve at the (f> = point. 

The right panel in Fig. [1] illustrates the 4'-{it — 0) degeneracy and the (epeT-)-0 guasi-degeneracy. On each curve, 
the condition 

P.^_,.^((e^60^*,/*,P) = P.,_.,((e^e.)""^'/'*™^^^), (25) 



is satisfied, where the values of the standard oscillation parameters are again taken as shown in Eq. (|19|) . and the 
maximal mixing for 023 and the NH are assumed in both side of Eq. (|^. We plot the curves of three cases with the 
following neutrino energies: 

E = {10, 30, 50} [GeV]. (26) 

For a fixed energy all the points on the curve give the same probability reflecting the (e^eT-)-0 degeneracy. However, 
if one considers other illustrative values of energies and draws the corresponding equi-probability curves passing 
through the true value point, then in a large region of parameter space, the equi-probability curves trace different 
paths. Consequently in these regions the {t^tr)-4> degeneracy can be removed by adding the spectral information. 
However, the figure also shows that the three curves cross at two points; one is the true value point (shown as the 
black dot), and the other is the fake solution which is referred as the 0-(7r — (f) degeneracy above for each curve. 
We can also find that at the region between the true solution and the fake solution, all three curves take a quite 
similar path indicating in this region the different probabilities for different energies have very little dependence on 
parameters. This means that it is hard to resolve the solutions at this region even with spectral information and 
hence we mention this as the gfiasi-degeneracy. We can draw a similar plots as Fig. [T] with IH as the true hierarchy. 

In Fig. [2] we plot the equi-probability plot for neutrino of energy 50 GeV and L = 3000 km. The true hierarchy 
is assumed to be NH and the true value point is again shown as a black dot in the figure. The dashed line shows 
the plot for the IH fit, on which the true oscillation probability can be reproduced. There are two points at which 
the NH and IH probability crosses each other. The conditions for obtaining these points can be worked out from the 
expression Eq. psp . In general the condition for degeneracy on these curves can be written as 

P.,^..((eMer),0,NH) - P„^^,^((e^e,)',0MH), (27) 

At the point where the NH and IH curves cross the e^tr and (p are same for both NH and IH. This gives, 

tan0=^. (28) 
For L = 3000 km and E' = 50 GeV, the above gives 140° and tt + 140° as obtained in the figure. 



V. NUMERICAL RESULTS: ALLOWED REGION ON THE (epe^)-0 PLANE 

In this section we present the results of our numerical analysis. We first present the allowed regions in the (e^eT-)-0 
plane for an OPERA-like detector at a distance of 130 km from a neutrino factory source and describe how the 
degeneracies are realized. This experimental setup have already been examined in Ref. [53 |. However, we will pay 
attention to the degeneracy of the solutions. Later, we will see that how this degenerate solutions are resolved 
including information of matter effect. 
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FIG. 2: Equi-probability plot for E = 50 GeV and L =3000km. The solid line denotes the NH fit and the dashed line denotes 
the IH fit. The true value of (eptr) and (p are marked by the black dot. The standard oscillation parameters are taken to be 
the values shown in Eq. p9p and 623 is assumed to be maximal. 



In Fig. [21 wc plot the function which is defined as' 

bin 

n 
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where Ni is the neutrino event number in the i-th energy bin, A represents the standard oscillation parameters and 
Vi is the variance which are appropriately defined to include the statistical and systematic errors. Here we adopt the 
values shown in Eq. (fT^ for the standard oscillation parameters. Since it is not possible to resolve the 623 degeneracy 
in this experiment (in the —>■ Vr channel), we take the reference true values for 623 as the maximal. The true 
mass hierarchy is assumed to be NH. The parameters for the non- unitary nature are taken as shown in Eq. (j20p . The 
left panel in Fig. [3] shows the allowed region in the (e^er)-0 plane. As discussed earlier, since the probability in this 
case is a function of sin^ 2^23, the 6*23 octant degeneracy does not give rise to any additional regions in the (e^eT-)-0 
plane and the solutions for true ^23 and wrong ^23 occur in the same place. Here the two solutions (two crescent 
regions) correspond to two choices for the sign of Am|]^ in the fit event. The figure also shows that for each hierarchy 
there is the (/>-(7r — (j)) degeneracy. The spurious solution corresponding to {e^er)-4' degeneracy is removed by using 
the spectrum information. There is a weak negative correlation between e^e,- and (f> for each allowed zone. We next 
discuss how one can eliminate the degenerate solutions in the {e^er)-<p plane by combining the experiments at various 
baselines. The remaining degeneracies are the sign[Am|]^]-(^ degeneracy, the ^-(Tr — (jj) degeneracy, and the (e^e,-)-^ 
quasi-degeneracy. The right plot of Fig. [3] shows the combining results of an OPERA-like detector at 130 km baseline 
and a 0.1 kton liquid Argon (LAr) type near detector which is located at L = 2 km^. The probability at the near 
detector depends on e^^tr only. Thus combining with this experiment helps to narrow down the allowed region but 
the degeneracies still exist. The correlation between (j) and e^e,- is now almost vanishing. 



® In the actual implementation, we adopt the Poisson distribution, add the appropriately defined priors, and marginalize also over the 

systematic parameters, following GLoBES software [59l l6Cll|. 
^ A 0.1 kt LAr detector as a near detector has been discussed in Ref. [61II . 
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OPERA-like 5.0 kt, L=130 km 



OPERA-like 5.0 kt L=130 km + LAr near 
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FIG. 3: Allowed regions in the {e^eT)-<j) plane for an OPERA-like detector at a distance of 130 km from a Neutrino Factory 
source (left), and for the same setup but with a 0.1 kt Liquid Argon near detector (right). 



In left panel of Fig. [4] we plot the allowed regions for the combination of a neutrino factory and a 
far detector which is located at L = 3000 km. A comparison of this figure with the equi-probabiUty 
that the middle region in Fig. [3] corresponds to the IH fit. As discussed in the previous section the 
of matter effect depends on coscj) which is different from the case in vacuum. Therefore, the (/>-(7r - 
well as sign[Am§2]-0 degeneracy can be removed by this matter term. This is reflected in the fig 
probabilities for NH and IH can still be equal when the condition Eq. (|27p is satisfied. This gives 



region in Fig. There is a positive correlation in this case between 6^67- and </> for each allowed ri 



100 kton LAr type 
plot Fig. [2] reveals 
main contribution 
- (/)) degeneracy as 
;ure. However the 
rise to the middle 
region. The result 
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FIG. 4; Same as Fig. [3] but we assume a 100 kt LAr detector at L 
near detector as Fig. [3] is added. 



3000 km in the left panel. In the right panel, the same 



combining the near detector is shown as the right panel in Fig. [H This helps to reduce the uncertainty in the e^e,- 
and since is a variable correlated with e^e,-, the uncertainty on (p is also reduced. Therefore, the allowed regions for 
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each hierarchy becomes much narrower as compared to the left panel. The allowed regions now are almost parallel 
to the (f) axis. The inclusion of the 3000 km removes the the (j)-{TT — <(>) degeneracy of Fig. [3] for each hierarchy. In 
addition, in such a long baseline experiment, it would be possible to obtain information on the sign[Am|2] from the 
other channels like v^. v^. Including it, we could remove the wrong hierarchy solution and solve the all degeneracies. 



VI. CONCLUSIONS 



Non-unitary mixing matrix is a generic feature for theories with mixing between neutrinos and heavy states and 
provides a window to probe physics at high scale. In this paper we have studied the possibility of probing non-unitarity 
of neutrino mixing matrix at neutrino factories. We considered the — > Vr channel and detectors at a distance of 2 
km, 130 km and 3000 km from the source. We show that for the channel at 130 km, there can be degenerate 

solutions even for 0i3=O in the (e^eT-)-0 plane where </> and e^er are the phase and moduli of the unitarity violation 
parameter. The degenerate solutions in the (e^e7-)-(/) plane are due to 

• (Am§i > 0, 0) ^ (Am§i < 0, -cj)) 

• (j) ^ i: — (j) 

• {<^ii<^T,4') -> ((e^er)',0') 

For a detector at distance 130 km from a neutrino factory source the last degeneracy can be removed using spectral 
information and no additional disconnected solution appear. By adding an experiment at 2 km the correlation between 
(p and e^tr can be reduced and the allowed ranges narrow down. For the 3000 km experiment the matter effects are 
relevant and this removes the first and second degeneracy listed above. However although the hierarchy degeneracy 
listed above gets removed, there can still be the degeneracy where probabilities for NH and IH give same values. If 
we consider only the 3000 km experiment then there is a greater correlation between e^€r-<j) and the allowed regions 
are larger as compared to the 130 km experiment. However, addition of the 2 km experiment to this reduces this 
correlation and the allowed regions become narrower. Although we have concentrated on the — > Vr channel in this 
study, if we combine the other channel like i/g ^ z^^ , we can obtain information on the hierarchy and then the allowed 
regions further reduce in size. 
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APPENDIX A: ANALYTIC FORMULAE 



In this section, we derive the expression of v^^ — > Vt oscillation probability in matter of constant density under some 
simplifying assumptions. If the neutrino mixing matrix is non-unitary then, although we can get the canonical form 
of the kinetic energy in the mass basis in terms of the flavour states the kinetic term is not diagonal. Therefore it 
is more appropriate here to consider the neutrino propagation equation in the mass basis. The neutrino propagation 
Hamiltonian in matter can be generally represented in the vacuum mass eigenbasis as follows, 



1 

2E 



Ami^ 



+aNC 



E ^72^^71 E l^^f E ^72^^- 



7— e,/i,r 



7 — e,/j,,r 



7— e,/i,T 



^ w;^w,^ ^ w;^W2, E 1^- 



731 



I) 



(Al) 
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where flee = 2\/2EGFne, inc = —V2EGf?in = are the charged and neutral current potentials respectively. 

We obtain simplified analytic expressions for the probability by solving the above equations in the limit ^13 — > 0, 
Am|]^/Am§]^ — > 0. In this limit the propagation Hamiltonian in the vacuum mass eigenbasis is 



where 



H.,, = {Hoh + {H,,.^^ + (H^^, + {H^ih (A2) 



C12 C12S12 0> 

iH^h=^{\ |+acc|ci2Si2 sl^ 0\}, (A3) 

Amj^J \ 

, 2C23S23S?2C0 -2c23S23Cl2Sl2C0 Sl2 (ci3e"'* - S^gB"^) 

= - ^^&t_cer \ -2c23S23Cl2Si2C0 2c23S23cf2C0 -Cl2 (cl3e-''* - S^gC'"^) ) , (A4) 




^Sl2(cl3e'*-si3C-'*) -Ci2(c23e"^-si3e-"^) -2C23S23C^ 



2 ^2 „ „ „2 



(iJ,2)„- =- — -Si2Ci2C^3 C?2ci3 C12S23C23 , (A5) 



S12C12C23 -Sl2S23C23\ 



2E 



-S12S23C23 C12S23C23 S23 J 



aj^^ . / ^243 -Sl2Cl2si3 S12S23C23 \ 

{H^2),j I -si2Ci2S^3 c?2si3 -C12S23C23 1 , (A6) 



2E 



S12S23C23 -C12S23C23 C23 J 



up to the second order of the epsilon parameters. In writing the above a part proportional to unit matrix is omitted as 
it contributes to overall phase. The Hamiltonian is separated into two parts — the zeroth order part Hq which includes 
Am§2 and acci and perturbations H^^^^, E[^2, and H^2, induced by the non-unitarity. Note that the non-unitarity 
effects appear always at the second order (or higher than that) of the parameters. 

Treating H^^^^, H^2 and H^2 as perturbations, the amplitude of the neutrino oscillation from a vacuum mass 
eigenstate Vi to the other vacuum mass eigenstate i^j can be written as 

Sji = iSo)ji + iSe^e^)ji + iSel)ji, +{Se^^)ji, (A7) 

where So is the zeroth order part, and S^^e^, S^2 , and S^2 correspond to the amplitudes with perturbations of H^^^^, 
H^2 , and H^2 respectively, which are calculated to be 

(A8) 

da;(e+'^°^)H(ife,eJ/™(e-'^°")^„ (A9) 
dx{c+'""-)ki (ff,2 ),™ (e-'^«-)™,, (AlO) 

L 















{8^2) ji 


= (c- 




(8^2) ji 







)kl{H,2)lmie-'"nrm, (All) 

Note that these amplitudes describe the transition between two vacuum mass eigenstates, Vi and lyj and a transition 
between flavour states can be obtained by sandwiching them by the flavour states^ which are described as [111, [H, Ig^ 

light 



^=Em/^|z.,) (A12) 



' a] I 



We underscore that, strictly speaking, this method has to be followed as it is not correct to write the the neutrino propagation in the 
flavour basis because the flavour states do not form a complete set for the propagation Hamiltonian. 
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The oscillation probability between two flavour states and lyp is derived as 



•^13 



^ Wpj (So + 5,^,, + S,2 + 

light ^ ^ 



\ 1=1 



light 



--{W^)^ 



\ fc=i 



= iV^ [l(^o)/3a|' + 2Re[(5*)^„(5,,,J^„] + 2Re[(5o*)0a(%)0„] + 2Re[(5*)0„(5,. )^„]] + 0(e% (A13) 

up to the first order perturbations. In the following, we will calculate each oscillation amplitude. 

Diagonalizing the zeroth order Hamiltonian ifg, we obtain the mass squared eigenvalues and the mixing matrix 
(Vo)j^ which connects the vacuum mass eigcnbasis vi with the mass eigenbasis in matter j/^. and in the limit which 
we adopt here, they take the following simple forms 



(i7o)fc = diag(acc,0, Am^i) = {VX,{H^) 'M) fk. 



where 



Cl2 -Sl2 
(Vo)- = I Si2 Ci2 



(A14) 



(A15) 



Therefore, the zeroth order amplitude in the vacuum mass eigenbasis becomes 



/ e 



V 



and that for the transition between two flavour states is 

{So)0o. = Wpj{So),,{W^), 
The oscillation probability at the zeroth order becomes 



(A16) 



(A17) 



P°'t^ = sin 26(23 (sin 26I23 + 2e^e^ cos 26*23 cos 0) sin^ 



AE 



e^e^ sin (f> sin 2023 sin 



2E 



+ Oie^), (A18) 



which is the same as the formula in the vacuum case. 

Next, let us turn to the perturbation terms. First one is the amplitude of S^^^^^- According to Eq. (jA9p . we can 
calculate it as 



where the parameters A is defined as 









-S2x23C0i 



2E 
iAmo, 







1 —1 

1 ~ e 2S 



-4*^(1-0-'^ 



S2x23C0ie ' 2E 



(A19) 



A ^ (4e-'* - sl,e'f>) 



and S2x23 = sin 2^23- The amplitude for Vn Vr transition is reduced to 



The contribution to the oscillation probability is calculated to be 



C0 1 + e 



'^2x23'^ 



C0) 1 - e-'- 



(A20) 



+ 0{e'). (A21) 



2^; 



3 . ^'"'31 



2E 



flNc \ 2 .2 Aml^L 

4e„.e^ I — 1 S2x23C2x23C0Sm 



^-^^ » Ami, 



AE 



(A22) 
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up to the second order of the e parameters. The contributions from S^2 and S^2 can also be calculated with the same 
way, which are 

2Re[(5o*).^(%).^] +2Re[(5*).^(5,.).,] = (^^) sl^.^c.^.^iel ~ e^) sm 

2 (^) ^L.3C.x.3(e^ - 4) sin^ (A23) 



From Eqs. (jA18[) . (|A22[) and (|A23p . the oscillation probability for i/^ Vr in matter can be expressed as 

Py^u^ = sin 2^23 (sin 26*23 + 2e^ier cos 26*23 cos 0) sin^ — (- e^Er sin cj) sin 26*23 sin — 

sin3 2023 cos sin - 4e^e, sin 2^23 cos^ 2023 cos sin^ 

|-) sin^ 2023 cos 2023(.^ - el) sin^ + (^^) sin^ 023 cos 2023(e^ - e^) sin ^ 



- 2 



Qnc 

+ 0(e3) + 0(si3) + 0(Am2,/Am2j. (A24) 
Since 023 ~ 7r/4, we can omit the terms which are proportional to cos 2023, a-nd finally, it reduces to 

P,^^,^ = sin^ 2023 sin^^^+e^e, sin 2023 sin (/) sin ^^-e^e, f j sin^ 2023 cos sin ■ (A25) 



APPENDIX B: EXPERIMENTAL SETUPS IN NUMERICAL CALCULATIONS 



The numerical work is performed using GLoBES software [53, [SO] which is modified for our purpose. We consider 
a neutrino factory as the source for v^s, based on NuFact2 from Ref. The number of the decay muon is assumed 
to be 1.06 • 10^^ per year and four years of running is being considered. Here, we concentrate on one polarity of the 
muon (/^~). The stored muon is accelerated to 50 GeV. 

We perform a binned x^-analysis with energy window from 1 to 50 GeV and width of each bin as 1 GeV. The signal 
event rate in the i-th energy bin is calculated as 



Nf^^'^'^ dE' dE,^-^P,^^y^{Ey)acc{EMEu,Ey,s, (Bl) 

Je,-AE/2 J Cl-t/^ 



where d$/di?,y is the beam flux, crcc is the charged current cross section, eog is the detection efficiency, and R is the 
energy smearing function which is assumed to be the Gaussian distribution, 

R{E,,E')= \ e-^^W, (B2) 

with cr = 0.15i?,y. E,y is the neutrino beam energy and E' is the reconstructed energy. The errors for the event 
normalization (Tnorm and so-called tilt-error (Tcai are given in the following subsections. We consider three experimental 
setups. 



1. NuFACT beam + OPERA-like detector with L = 130 km 



We consider an OPERA-like detector at a distance of L = 130 km from a Neutrino Factory beam, which was 
examined in Ref. [13]. The detector mass is assumed to be 5.0 kton The matter profile is assumed to be constant 
with the density 2.7 g/cm^ although the matter effect itself is not significant in this setup. 

For the signal detection efficiency, the errors, and the backgrounds, we follow the gib-file OPERA. gib. Since this 
gib-file is designed for the CNGS beam source, the numbers should be modified for the neutrino factory beam source. 
Here, we use the numbers shown in Tab. [H 
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i^fi — > i't Appearance 


norm 


0"cal 


Signal 
Background 


0.1056 Ur)cc 

3.414 X 10"^ ® (l/^ -> !/a;)NC 3.414 X 10"^ ® -> !?rc)NC 


0.05 
0.05 


10-* 
10-'* 



TABLE I: Rules for the experimental setup NuFACT+OPERA-like detector. 



2. NuFACT beam + LAr near detector 



In this set up we consider an 0.1 kt liquid Argon detector at 2 km far away from the beam source, which has been 
discussed in Ref. [IH. Here we follow the gib-file, ICARUS. gib but modify the background estimation. 



i>T Appearance 


norm 


0"cal 


Signal 
Background 


0.0758 ®{v^ vr)cc 
8.502 X 10-' ® [uf, ^ v^)^c 8.502 x 10"' ® {ve ~* /?a.)NC 


0.05 
0.05 


10-* 
10-* 



TABLE II: Rules for the experimental setup NuFACT+LAr detector. 



3. NuFACT beam + large LAr far detector 

In order to solve the 4>-{tt — 4>) degeneracy and the {e^trYfl) gitosi-degeneracy, it is effective to observe the matter 
effect coming from the non-unitarity effect. To get the matter effect, we need a long baseline. Here, we set L = 3, 000 
km and adopt 3.3 g/cw? as the matter density. However, in such a long baseline setup, we need a huge detector 
to collect enough event rates. We assume 100 kton LAr detector whose rules are taken from ICARUS. gib, which is 
modified as the same manner as the LAr near detector setup. 
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